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Abstract. We discuss the relation between the Gaussian bino- 
mial and multinomial coefficients and ordinary binomial and multi- 
nomial coefficients from a combinatorial viewpoint, based on ex- 
positions by Knuth, Stanley and Butler. 



1. Background. The Gaussian binomial coefficients were introduced 
two hundred years ago by Carl Friedrich Gauss [7] as a tool to find a 
formula for the following sums, now called Gauss sums: 



Gauss had easily computed these sums up to sign in 1801, but it took 
him four years of intense effort to resolve the sign ambiguity; he solved 
the problem only in 1805. This aspect of Gaussian binomial coefficients 
makes for a fascinating story in itself, but we shall simply refer the 
reader to [T], where an exposition of Gauss's proof (among other things) 
can be found. 

This article concentrates on a different aspect of Gaussian binomial 
coefficients: they arise as the answer to a counting problem in lin- 
ear algebra involving finite fields. Vectors with real coordinates arise 
naturally in our efforts to describe nature by mathematics. Space is 
described by three real coordinates, space-time by four. Physicists need 
to keep track of the position and momentum of a particle in space in 
order to be able to predict is position in the future, leading to the use 
of six real coordinates for each particle. 

Number theorists like to work with vectors with integer or rational 
coordinates: prospective solutions to Fermat's famous equation 



p-i 




for all primes p. 



n=0 



(1) x n + y n = z n 

are vectors with three integer or rational coordinates. 
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Finding out whether integer solutions exist to a given Diophantine 
equations can be notoriously difficult, as evidenced by all the fuss over 
(PQ). The most powerful weapon in the mathematician's arsenal to 
tackle this problem was also introduced by Gauss: the notion of modu- 
lar arithmetic, which is the arithmetic of remainders. Four hours after 
9 o'clock, it is 1 o'clock, because the remainder when 9+4=13 is di- 
vided by 12 is 1. The clock does arithmetic modulo 12, but one can do 
it modulo any number n > 2. In arithmetic modulo n, two integers a 
and b are identified if their remainders after division by n are the same; 
or, as number theorists say it, their residues modulo n are the same. 
We write 

a = b mod n 

Thus, there are n residue classes of integers modulo n, represented by 

0,1,2,. ..,7i-l. 

Addition and multiplication carry over to modular arithmetic and sat- 
isfy the same rules of commutativity, associativity and distributivity 
that hold for the integers. 

When n is a prime number (call it p), something special happens: it 
is possible to divide by any non-zero residue modulo p, meaning to say 
that for any x not divisible by p, there exists an integer y such that 

xy = 1 mod p. 

This integer y can be thought of as the reciprocal of x modulo p, 
and we may write it as 1/x. A number system, namely a set with 
the operations of addition and multiplication, which satisfies the usual 
axioms of commutativity, associativity and distributivity (it is assumed 
that the set comes with a '0' and a '1'), where division by any element 
different from is possible, is called a field. For every prime power q, 
Evariste Galois (1811-1832) constructed a finite field with q elements 
[6]. In 1903, Eliakim Hastings Moore showed that for each prime power 
q, all fields with q elements are isomorphic [9j. In other words there is, 
in essence, just one field with q elements for each prime power q. 

Vectors with coordinates in any field behave very much like vec- 
tors with real numbers as coordinates. The usual notions of linear 
independence, basis, and subspace carry over from vectors with real 
coordinates to vectors with coordinates in finite fields, and will be used 
freely throughout this article. We recall the essentials: a set of vectors 
which is closed under addition and scalar multiplication (a scalar is an 
element of the underlying field) is called a linear subspace. A collec- 
tion v i, • • • , v n of vectors is said to be linearly independent if, for each 
1 < i < n, there exists a linear subspace which contains v%, . . . , t>j_i 
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but not V{. A basis of a linear subspace is any maximal linearly in- 
dependent subset. Every vector in the subspace can be written as a 
sum of scalar multiples of elements from a basis. All bases of a linear 
subspace have the same number of elements, and this number is called 
the dimension of the linear subspace. 

2. Introduction. Let F be a finite field of order q. Let V = F n be the 

space of vectors with n coordinates in F. For every k < n, define (£) 
as the number of linear subspaces of V of dimension k. The number 
(^) is called a Gaussian binomial coefficient. One of the goals of this 

article is to explore the relationship between (™) and the binomial 

coefficient ("J , which is the number of ways of choosing k objects out 
of n (n choose k). 

It is not difficult to write down a formula for (™) . To do this, 
note that a k- dimensional subspace is specified by giving k linearly 
independent vectors {i>i, . . . , U&} in V. In how many ways can this 
be done? Firstly, Vi can be taken to be any non-zero vector in V. 
Therefore there are q n — 1 choices for v\. Given v\, v 2 can be chosen to 
be any vector which is not in the subspace spanned by v±. Since this 
subspace has q elements, there are q n — q choices for t> 2 . Continuing 
in this manner, we see that given Vi, . . . , vi for I < k, there are q n — q l 
choices for vt+i. The number of sets of k linearly independent vectors 
in V is therefore 

(? B -l)(9 B -9)---(9 B -9*- 1 )- 

Applying the above formula to the special case where n = k, we see 
that each /c-dimensional subspace of V (which is a /c-dimensional vector 
space in its own right) has 

{q k -l){q k -q)---{q k -q k - 1 ) 

bases. To obtain the number of /c-dimensional subspaces, we divide the 
first expression by the second one. Thus the number of A;- dimensional 
subspaces of V is 

fn\ (q n -l)(q n -q)---(q n -q k - 1 ) 
U W, (?* -to*-?*" 1 )' 

So far, q has been the order of a finite field (which can be any prime 
power), but the above expression is also a rational function of q with 
a denominator that vanishes only at q — 1. This allows us to get a 
value for (™) for any complex number q ^ 1. Using L'Hopital's rule 
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one computes 

q n — q l n — i 
lim — r = : 

q-+l q K — q l k — % 

for i — 0, . . . , n — 1. Therefore 

n(n — 1) • • • (n — k + 1) /n\ 

3. Counting using echelon form. In 1971, Donald Ervin Knuth 
provided an elegant explanation for the identity ([3]) in [8] based on the 
idea that every subspace has a unique basis which is in reduced row 
echelon form. 

Let F be a field with q elements. Any k linearly independent vectors 
in F n can be arranged into a k x n matrix of rank k, where the entries 
of the zth row are the coordinates of the zth vector. In other words, 
every fc-dimensional subspace of F n is the row space of an k x n matrix 
of rank k. The row space of such a matrix does not change under the 
following elementary row operations: 

(1) permutation of the rows 

(2) addition of a scalar multiple of one row to another 

(3) multiplication of a row by a non-zero scalar 

A k x n matrix is said to be in reduced row echelon form if 

(1) the left-most non-zero entry of each row is 1 (let's call it a 
"leading 1") 

(2) all the other entries in the column of a leading 1 are zero 

(3) the leading 1 in any row occurs to the right of the leading 1 in 
the row above it 

A matrix in reduced row echelon form looks something like 

/0---0 1 *•••* *•••* *---*\ 
0---0 0---0 1 *•••* *•••* 
0---0 0---0 0---0 1 *■••* 

where the *'s represent arbitrary elements of F. 

The reader should not have much difficulty in seeing that the elemen- 
tary row operations described above can be used to reduce any k x n 
matrix to reduced row echelon form. If the matrix has rank k, then 
all the rows in the reduced row echelon form are non-zero. Moreover, 
if two matrices in reduced row echelon form have the same row space, 
they are equal. 

Given a matrix in reduced row echelon form, delete all the entries 
in each row to the left of the leading 1. Then remove the columns 
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'0 1 1 1 2 X 
1 2 
.0 1 1 



Figure 1 . From a matrix to its Ferrers diagram 



containing the leading l's. Finally, replace each remaining entry with 
a *. The result is a pattern of *'s inside a grid with k rows and n — k 
columns. These patterns are characterized by the property that except 
for the *'s in the first row, every * has a * above it, and except for the 
*'s in the (n — k)th column, every * has a * to the right of it. They are 
called Ferrers diagrams. Figure [T] illustrates an example of this process 
when n = 7 and k = 3. On the left is a matrix in reduced row echelon 
form. The leading l's occur in the second, fourth and fifth columns. 
After deleting the entries to the left of the leading l's, deleting the 
columns with leading l's, and replacing the remaining entries with *'s 
the Ferrers diagram on the right is obtained. 

The above process can be easily reversed: let ei, . . . , denote the k 
coordinate vectors in F n , written a columns. Starting with a Ferrers 
diagram A in a k x (n — k) grid, replace each * with an element of 
F (this can be done in g' A ' ways, where |A| denotes the number of *'s 
in A) and each vacant square in the grid by a 0. Insert ei, . . . , e& in 
reverse order as follows: insert to the left of the left-most * in the 
bottom row. Having inserted e i+ i, . . . , e/., insert e$ to the left of all the 
*'s in the ith row and all the columns ej + i, . . . , e n . This gives all the 
matrices associated with A. 

The problem of counting the fc-dimensional subspaces of F n is equiv- 
alent to counting the number of k x n matrices of rank k in reduced 
row echelon form. Each matrix in reduced row echelon form gives rise 
to a Ferrers diagram inside a k x (n — k) grid. Each Ferrers diagram 
A can be obtained from g' A ' matrices in reduced row echelon form. We 
have shown that 



XCkxn—k 



where Xckxn — k is supposed to indicate that A is a Ferrers diagram 
in a grid with k rows and n — k columns. 

The expression (j3J) for g-binomial coefficients demonstrates that m 
is a monic polynomial in q of degree k(n — k) with positive integer 
coefficients, which is not evident from (T5]). In the next section, we take 
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a closer look at the right hand side of Q to give, among other things, 
another proof of fl3j). 

A partition of a natural number n is a decomposition 

n = n± H h«fc, 

where each part rii is positive. If one does not distinguish between 
different reorderings of the same summands, one may assume that n\ > 
. . . > rik- A Ferrers diagram A with |A| = n can be thought of as a 
partition of n, the parts being the number of *'s in each row of A. Thus, 
has the following interpretation: 

The coefficient of q r in ("J is the number of partitions 
of r into no more than n — k parts, with each part being 
no larger than k. 

4. Paths, subsets, and permutations. Given a Ferrers diagram 
A C k x n — k, we identify it with a path from the top-left corner to 
the bottom-right corner of a rectangular grid of squares of height k and 
length n — k as follows: begin at the top left corner. As each stage, if 
you find yourself at the top left corner of a square with a * in it, move 
one step downwards. If not, move one step to the right. In the example 
with n = 7 and k = 3 that we considered in Figure [TJ this process is 
illustrated in Figure [2j Such a path always consists of n segments of 
unit length, of which k are vertical and n — k are horizontal. Index 
the segments of such a path by the numbers 1, . . . ,n, starting at the 
top-left corner and ending at the bottom-right corner. The path is 
completely determined by specifying which k of these n segments are 
vertical. Figure [3] shows all ten paths for n = 5 and k = 2. Directly 
beneath each path is listed the subset of {1, 2, 3, 4, 5} corresponding to 
the vertical segments. 

Since the paths are completely specified by which k of the n seg- 
ments are vertical, the number of such paths is . This gives a more 
illuminating proof of the identity ([3]): 

;-jsQ =«s E 3 |A| = E i-(;> 

v ' 1 Xckxn-k Xckxn-k v ' 





* 


* 


* 






* 


* 




Figure 2. From a Ferrers diagram to its path 
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{4,5} {3,5} {2,5} {1,5} {3,4} 
(12345) (12435) (13425) (23415) (12534) 



{2,4} 



{1,4} 



{2,3} {1,3} {1,2} 



(13524) (23514) (14523) (24513) (34512) 
Figure 3. Paths, subsets and permutations 

This proof trumps the one in Section [2] by virtue of being combinato- 
rial; in effect, it constructs a surjective function K (call it a collapse) 
from the set of k- dimensional subspaces of F n to the set of subsets of 
{1, . . . , n} of order k with all pre- images having cardinality a power of 
q. We shall now give a combinatorial interpretation of the number |A|. 
In order to do this, we associate a permutation -k\ of (1, . . . , n) (namely 
a rearrangement of these symbols) to each Ferrers diagram A contained 
in an k x n — k grid. The permutation 7T\ is constructed as follows: 
look at the path corresponding to A, with its segments indexed by the 
numbers 1, . . . , n as before. First write down the indices corresponding 
to the horizontal segments in increasing order. Then write down the 
indices corresponding to the vertical segments in increasing order. 

In Figure [31 for n = 5 and k = 3 the permutation associated to 
each Ferrers diagram appears below the subset corresponding to the 
horizontal segments. Note that only ten of the 120 permutations of 
(1, 2, 3, 4, 5) appear in Figure [31 These ten permutations are character- 
ized by the property that each entry with the possible exception of the 
third one is smaller than the next one. 

More generally, let (7r(l), . . . , n(n)) denote a permutation of (1, . . . , n). 
The descent set of n is defined as 

£>(tt) = {i e {l,...,n- 1} : tt(z) > tt(z + 1)}. 

The permutations tt\ that correspond to paths in a k x n — k grid are 
precisely the ones for which D(ir) C {k}. 
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We are now ready to give an interpretation of |A| in terms of ti\. 
For a permutation it of (1, . . . , n), an inversion of 7r is a pair such 
that 1 < % < j < n but > Let inv(7r) denote the number of 

inversions of ir. We claim that 

(5) |A| = inv(7r A ). 

Indeed, if (z, j) is an inversion of 7r A , then since (vr A (l), . . . ,7r A (/c)) and 
(7Ta(/c + 1), • • • , tta(^)) are increasing sequences, we must have 1 < i < k 
and k < j < n. The box in the zth column and (j — k)th row of a Ferrers 
diagram Ainafcxn-I; grid contains a * if and only if the associated 
path has taken j — k downward steps before it has taken i rightward 
steps. But this is precisely when (the index of the ith rightward 
step) is greater than 7r(j) (the index of the (j — k)th downward step). 
The reader who finds the above reasoning hard to follow should try at 
first to verify ([5]) for the paths in Figure [3j 

By passing from A to tt\, we can rewrite (jl]) in yet another form: 

(6) (") = £ 

Thus the coefficient of q r in is the number of permutations with r 
inversions and descent set contained in {k}. 

5. Multinomial coefficients. Recall that multinomial coefficients given 
by the formula 

n \ n\ 



\k\ . . . k m J k\ \ ■ ■ ■ k m \ 

count the number of ways of writing {l,...,n} as a disjoint union 
Xi U - • • U X m where \Xi\ = ki for i = 1, . . . , m (of course, one assumes 
that k\ H h k m — n). Let 

Y X = X X 

Y 2 = X 1 U X 2 



Ym-i — Xx U • • • U X m . 

Y m = X 1 U---UX m ={l,...,n} 

Let Si = k\ + • • • + ki for each i e {1, . . . , m — 1}. Then Y\ C Y 2 C 
■ ■ ■ C Y m _i is a nested sequence of subsets such that |Yj| = Si for all 
i G {1, ... ,m — 1}, and it is clear that the sequence of disjoint sets 
(Xi) can be recovered from the sequence of nested sets (Yi). Writing 
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S for an increasing sequence (si, . . . , s m _i) in {1, ... , n}, we shall use 
the notation 

\s) = ^{ Sl C " ' C Sm = ^' ' ' ' ' n } '' = Si for 1 - i < m -" > ' 
We have: 

= U • • • K 

where ki = Sj — Sj_i for 1, i < m, fci = Si and k m = n — s m _i. This 
interpretation of the multinomial coefficients has an obvious analogue 
for vector spaces and subspaces. Define 



#{Vi C • ■ ■ C V m _i C F n : Vi is a subspace of dimension Sj}. 
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The multinomial coefficients can be expressed in terms of the binomial 
coefficients. Clearly, the number of choices for S n -i inside S n is ( n ), 

the number of choices for 5 , n „ 2 inside each choice of S n -x is (* n_1 ) and 



so on, so that 



Similarly, 

(9) 



n\ _ s 2 \ /s m -i\ / n 

S J \ S lJ \Sm-2/ \Sm-l 



SJn \ S l) a \Sm-2j n \Sm-l 



These expressions allow us to easily deduce some properties of g-multinomial 
coefficients from the corresponding properties of g-binomial coefficients. 
For example, the expression (J5J) expressing a g-binomial coefficient as a 
rational function in q with denominator non-zero except at q = 1 also 
shows that a g-multinomial coefficient is a rational function of q with 
denominator non-zero except at q = 1. From the identity ()3]) we can 
deduce that 

'n\ / n 



(10) lim 

g->-i V b J „ \o 



3 



Similarly, from the identity 01]) we can deduce that each g-multinomial 
coefficient is a monic polynomial in q of degree k\ - ■ ■ k m with positive 
coefficients. A slightly more careful analysis will allow us to find the 
analogue of ([6]) for multinomial coefficients. Not only will it give us a 
combinatorial interpretation for the coefficient of a power of q in the 
multinomial coefficient, when combined with the principle of inclusion 
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and exclusion, it will also have the rather surprising consequence that 
the alternating sum 

' n 



S 



ScT 

(where \T — S\ denotes the number of elements of T which are not in 
S) is a polynomial in q with non-negative coefficients. 
In order to simplify notation, for any S C {1, . . . , n}, let 

E n (S) = {ne E n : D(n) C S}. 

Then (|6]) can be rewritten as 



q 

1 7TGS„({fc}) 



If we expand the right hand side of ()9]) using the above identity, we get 
(11) 

. . . ^inv(7T 1 )+---+inv(7r m ) 
7rieS S2 ({si}) 7r m _ 2 GE Sm _ 1 ({s m _2}) 7r m _iGS„({s m _i}) 

We claim that the formula 

$(7Tm-l, 7T m _ 2 , . . . , 7Ti) = 7T m _i O 7T m _ 2 O • • • O 7Tl 

defines a bijection 

$ : S S2 ({ Sl }) x £ S3 ({s 2 }) x • • ■ x S Sm _ 1 ({ Sm _ 1 })^S n (5) 

(where S r is identified with the subgroup of S n which permutes the 
first r elements of {1, . . . , n}) such that 

inv($(vr m _i, vr m _ 2 , 7Ti)) = inv(vr m _i) + inv(vr m _ 2 ) H h inv(TTi). 

allowing us to rewrite ffTTl) as 



inv(7r) 

1 7T6S n (5) 

Indeed, using induction on m, it suffices to verify 
Lemma. The formula 

(ir', 7T m _i) h-> 7r' O 7T m _i 

defines a bijection 

£ Sm _i(-|>i, • • • , s m _ 2 }) x E„({s m __i}) -)■ £„(S) 

(12) inv(7r m _ 1 o tt') = inv(7r m _i) + inv(Tr') 
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(where £ Sm _i is identified with the subgroup of S n which permutes the 
first s m _i elements of {1, ... , n} ). 

Proof. Firstly, note that if n' G S Sm _ 1 ({s 1; . . . , s m _ 2 }) and 7T TO _i G 
S n ({s m _i}) then both tt' and 7r m _! are increasing functions on each of 
the segments {s r _i + 1, . . . , s r } for r = 1, . . . , m, and therefore, their 
composition is also increasing on these segments. Therefore 7r'o7r m _i G 
£„(£). 

It remains to prove (fT2|) . For each permutation 7r, let 7(7r) denote 
the set of inversions of tt, namely, the set of pairs i < j for which 
7r(i) > 7r(j). In general, if a and r are permutations then 

/(a or) C r _1 (J(«7)) U/(r) 
from which it follows that 

inv((7 o r) < inv(c) + inv(r) 
If in addition, 7- _1 (I(<7)) n J(r) = 0, then 

I(o- or) = r _1 (J(<7)) U/(r) 

and therefore, 

inv(a o r) = inv(cr) + inv(r) 
Hence in order to prove (jT2l) . one must show that 

(13) 7T / - 1 (/(7r m _ 1 ))n/(7T / ) =0. 

Since tt' acts only on {1, . . . , s m _i}, if (z, j) is an inversion of tt' then 
7r'(j) < 7r'(z) < s m _i. Since 7r m _i has no descents in this range, 
(tt' (i) , tt' (j)) can not be an inversion of 7r m _i, proving ffT31 . □ 

We have succeeded in generalizing ([6]) to multinomial coefficients: 



(14) c = £ ^ mvW - 



D(?r)cS 



Combining ([TO]) with (JHD 



(15) Q J = #{tt G S n |D(7T) C 5} 

We shall now combine these identity with the principle of inclusion and 
exclusion to get a surprising positivity result for alternating sums of 
multinomial coefficients. 
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6. Principle of inclusion and exclusion. This principle is most 
commonly known as a technique for computing the cardinality of a 
union of finite sets in terms of cardinalities of various intersections. 
What follows is a more abstract formulation (see [TTJ Section 2.1]). 

Let R be a finite set. The power set 2 R of R is the set of all subsets 
of R. The principle of inclusion and exclusion can be interpreted as 
saying that two functions a, j5 : 2 R — > C satisfy the identities 

(*) 0(T) = 5>(S)- 

SCT 

for all S, T C R if and only if they satisfy the identities 
(*) a(T) = ]T(-1) |T - 5| /3(S) 

SCT 

for all S,T C R. 

Proof. Assume Then 

5>i)i^(<?) = 5>i)i r -*i 2>w 

SCT SCT UCS 

£/cT 1/cScT 

If m = |T — J7| > 0, then the inner sum is ^^L ( — ^Y (7) = ^- There- 
fore, the expression reduces to a{T). Conversely, assume (U]). Then 

ScT SCTUCS 

^\S-U\ 

UCT UCSCT 



and as before, the inner sum is zero unless U — T, in which case it is 
one. □ 

7. Counting permutations with a given descent set. The prin- 
ciple of inclusion and exclusion allows us to use (TT5j) to write a formula 
for the number of permutations with a given descent set in terms of 
multinomial coefficients. Take R = {1, . . . , n} and let 

a(S) = #{tt G E n \D(7r) = S}. 

Then by flU} 

P(T) = £ = #{vr g £ n |D(7r) CT}= Q . 

SCT ^ ' 
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Thus, by the principle of inclusion and exclusion 

#{vtG S n |D(vr) = r} = g(-l)l^l(^ 

8. A surprising positivity result. Let 



Then 



D{n)=S 

(3 q (T) = 5> g 0S) 

SCT 

= E E ? mv< " > 

ScTD(tt)=S 

= g inv M 

D(w)cT 

n N 
* <? 

The principle of inclusion and exclusion (Section [6]) gives 

(16) E(- 1 ) |T " s| (c) = E ? invW 

SCT \ / q D(tt)=T 

Not only is this alternating sum positive; in fact it is a polynomial in 
q with positive coefficients! 

9. Closing remarks. The combinatorics of Gaussian binomial coeffi- 
cients continues to fascinate mathematicians today. That the binomial 
coefficients (?) increase with k when k < n/2 and decrease for k > n/2 
is easy to see. An analogous statement for Gaussian binomial coeffi- 
cients is also not too difficult. Such sequences of numbers are called 
unimodal. Towards the end of Section [31 we saw that is a polyno- 
mial in q with positive coefficients. The first combinatorial proof of the 
unimodality of these coefficients was found as late as 1990 by Kathleen 
M. O'Hara [10] (see also an expository article on O'Hara's proof by 
Doron Zeilberger |12j). 

Counting subspaces in a finite dimensional vector space over the field 
Z/pZ is a special case of the problem of counting subgroups inside a 
finite abelian group. Every finite abelian group can be written as a 
product of over a finite set of prime numbers of groups of the form 

(17) A p , x = Z/p M Zx---xZ/p x <Z 
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where A = (Ai > • • • > A;) is a sequence of positive integers. 

A generalization of the problem of counting k- dimensional subspaces 
in an n- dimensional space is the problem of counting subgroups of type 
A P41 inside A p \ for /i = > • ■ ■ > fi m ). The generalizations of (T5]) 
and ([3]) have been known for a long time (e.g., Delsarte jl]) and are 
related to multiset combinatorics (a multiset is a set where elements 
are allowed to appear with multiplicities, for example, as in the case 
of roots of a polynomial). However, the analogues of (j!4p and (TIB]) are 
more subtle, and can be found in Lynne Butler's beautiful monograph 
i- 

In recent years, techniques from combinatorics have been combined 
with those from analytic number theory (namely, zeta functions) to 
study enumeration problems in algebra with great success (see, for 
example the survey article [5]). The reader who wishes to start learning 
the language and basic techniques of modern combinatorics need look 
no further than Richard P. Stanley's amazing book [TTJ. A slightly 
different take on some of the contents of this article can be found in 
Henry Cohn's expository article [3J. 
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